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SUMMARY 

Progress in the development of the hierarchy 
of turbulence models for Reynolds-averaged Navier- 
Stokes codes used in aerodynamic applications is re- 
viewed. Steady progress is demonstrated, but transfer 
of the modeling technology has not kept pace with the 
development and demands of the computational fluid 
dynamics (CFD) tools. An examination of the pro- 
cess of model development leads to recommendations 
for a mid-course correction involving close coordina- 
tion between modelers, CFD developers, and applica- 
tion engineers. In instances where the old process is 
changed and cooperation enhanced, timely transfer is 
realized. A turbulence modeling information data base 
is proposed to refine the process and open it to greater 
participation among modeling and CFD practitioners. 


1. INTRODUCTION 

Despite the significant advances of computational 
fluid dynamics (CFD), turbulence modeling is still crit- 
ical to its success for aerodynamic applications. New 
aircraft performance requirements are pushing the en- 
velope of our experience and “time to market” con- 
siderations are requiring more sophisticated CFD early 
in the design cycle. A successful CFD tool would 
enhance our understanding of the effects of viscous, 
high Reynolds number flows associated with the de- 
sign of these aircraft. The three-dimensional (3-D) 
time-dependent solution of the Navier-Stokes equa- 
tions could provide an exact description of the tur- 
bulent motion, but the range of time and length scales 
associated with turbulence are such that they cannot be 
resolved when computing complex aerodynamic flows. 
As a consequence, the Reynolds averaged form of 
the Navier-Stokes equations together with a turbulence 
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model are the most practical means today of comput- 
ing complex aerodynamic flows. Industry has started to 
use Reynolds-averaged Navier-Stokes (RANS) codes 
in their design cycle, even though the physical model- 
ing is less than satisfactory. 

There is no doubt significant progress in the field 
of turbulence modeling has been made. However, in 
contrast to the revolutionary pace of CFD develop- 
ment, turbulence modeling development has been evo- 
lutionary and the resulting pace of improvement has 
frustrated the CFD community. Some of the factors 
leading to the frustration are: the number of modeling 
research and development studies has proliferated over 
the last decade, yet no clear choice for suitable models 
seems to be emerging; the test cases used to validate 
turbulence models are only weakly relevant to “real” 
aerodynamic flow applications; reported successes are 
fragmentary or inconsistent and numerical aspects and 
their impact on efficiency are rarely discussed; and, 
there is a general lack of a systematic effort to transfer 
“successful” models to CFD application codes. 

The latter point is a crucial aspect too often ig- 
nored and results in CFD applications being performed 
with models that fail to represent the best available al- 
ternative. Modeling and CFD development typically 
proceed on independent paths. CFD developers are ex- 
pected to pick models from a myriad of choices, and, 
there is general lack of feedback between the groups on 
modeling successes and failures. It is absolutely nec- 
essary to rectify the situation because the likelihood 
of having a single code with a single turbulence model 
that can solve the breadth of CFD applications encoun- 
tered in aerodynamics is remote. A viable systematic 
effort requires attention to the complete model devel- 
opment process and close collaboration among the two 
disciplines. 

In this paper, progress in modeling is described 
first. Next, the process of model development is ex- 
amined to provide insight into the reasons for the per- 
ceived slow pace of progress. Ideas for a mid-course 
correction in the process that could lead to a more sat- 
isfactory pace are proposed and discussed. Examples 



are given throughout to provide foundation to the ideas 
being advocated. 

2. PROGRESS 
2.1 Background 

The formalism used to derive the RANS equa- 
tions leads to the well known closure problem wherein 
the fluid motion is described by its mean and suit- 
ably averaged fluctuating motion. The latter is ac- 
complished through turbulence modeling. A review 
of early progress in modeling provides an informative 
prelude to our discussion on the current status. 

In 1968, the AFOSR-IFP Stanford Conference 
(ref. 1) was held to determine whether emerging nu- 
merical techniques together with a turbulence model 
were sufficient to solve spatially developing boundary 
layers. Finite difference numerical procedures were 
judged to provide suitable means for solving the bound- 
ary layer form of the RANS equations. The majority 
of comparisons with data were accomplished with in- 
compressible codes using eddy viscosity models. No 
single modeling approach emerged as superior, but the 
potential of using RANS codes was demonstrated. 

In 1969 (ref. 2) and 1972 (ref. 3) NASA con- 
ferences were held to assess early modeling progress 
on compressible boundary layers and shear lay- 
ers. The available models, most of which were 
eddy-viscosity types and corrected for compressibility 
through Morkovin’s hypothesis, were generally suc- 
cessful for boundaiy layers, but failed in some spe- 
cific instances such as incompressible reattaching shear 
layers and growth rate predictions of compressible 
shear layers. Suggestions for further study were preva- 
lent throughout the discussions, but optimism for ex- 
pected improvements prevailed and follow-on research 
intensified. 

During the next decade, considerable effort was 
undertaken to improve turbulence models and broaden 
the range of applications. Spurred by the arrival of the 
supercomputer, the effort focused on the closure prob- 
lem. In particular, the development of two-equation 
and higher order Reynolds stress transport closure 
models pioneered by Launder and his colleagues of- 
fered the hope for accurate predictions of complex tur- 
bulent flows and perhaps the development of a univer- 
sal model. 


The 1980-1981 AFOSR-HTTM-Stanford Confer- 
ence (ref. 4) was organized to assess general progress 
in modeling complex turbulent flows during the decade 
of the ’70s. The conclusions that emerged from the 
conference evaluation committee were mixed. On the 
one hand, it was concluded that complex flows (still 
simple compared to those associated with aeronautical 
applications), including separated flows, could indeed 
be calculated with the more sophisticated numerical 
methods and models. On the other hand, the accu- 
racy of the computations and the performance of the 
higher order Reynolds-stress models was disappoint- 
ing. Including more physics did not necessarily lead 
to more accurate results and there was concern that 
computational errors (e.g., numerical convergence and 
grid resolution) affected the resulting conclusions. It 
was also apparent that the search for a universal model 
was not realized. 

After a decade, Bradshaw, Launder, and Lumley 
initiated a sequel to the 1980-81 conference. Their 
purpose was to assess subsequent progress in RANS 
model developments for complex flows during the in- 
tervening years. They developed and provided a modi- 
fied, narrower scope evaluation data base, and required 
contributors to provide the results, either by postmail 
or electronic mail. The format was interactive and 
allowed modelers to see their comparisons relative to 
others and make adjustments if they thought they could 
improve their own predictions. 

Bradshaw et al. (ref. 5) presented their conclu- 
sions on modeling progress with the aid of a single 
figure. The conclusions that emerged from their study 
were disappointing in light of the latitude provided to 
the contributors. Figure 1, taken from their report, 
shows the skin friction coefficient on a flat plate at 
momentum-thickness Reynolds number of 10,000 plot- 
ted against /ioo, the value of U/u T at u r yj v = 100. 
The known value from experiment is depicted by the 
large “plus” symbol, which covers the range of exper- 
imental scatter. The other symbols represent various 
contributors’ predictions and they scatter dramatically 
about a mean curve fit through them. They do not re- 
produce the experimental results. The flagged symbols 
are values predicted using the standard k — e model, 
some with wall functions and some with integration 
to the wall. They do not agree with one another and 
show that different numerical schemes can lead to scat- 
ter in predictions even for the same model. Bradshaw 
et al. surmised that physical modeling progress was 
extremely difficult to evaluate in the absence of any 


2 



consistent numerical assessment procedure even for the 
supposedly “universal” viscous wall region. 

It is becoming clearer as more and more code 
assessment studies are conducted that errors are not at- 
tributable to modeling deficiencies alone. For example, 
at the recent workshop on CFD code assessment for 
turbomachinery (ref. 6), it was concluded that model 
deficiencies, numerical code errors and lack of training 
in the use of CFD codes were all factors contributing 
to differences between numerical solutions and their 
subsequent differences with data. The organizers also 
concluded that a single test case, although relevant to a 
practical flow, was probably too complicated to assess 
the accuracy of various turbulence models. 

2.2 Current Status 

The status of various modeling closures will be 
discussed in the order to which the Reynolds stresses 
are approximated. 

The Reynolds stress transport models solve the 
transport equation for Reynolds stresses, uiuj directly: 

DujUj 

= dij "F Pij "F 4*ij (1) 

The first term in the L.H.S. and the second term in 
the R.H.S. are convection and production terms, re- 
spectively, and require no modeling; the first term in 
the R.H.S. is the diffusion term and is in general mod- 
eled by a gradient diffusion approximation; the third 
term in the R.H.S. is the pressure-strain correlation. A 
majority of the modeling efforts have focused on this 
term. The last term is the dissipation term which is in 
general related to the scalar dissipation rate, governed 
by a transport equation. This type of model requires 
seven equations, in addition to the mean flow equa- 
tions. Currently, there are a least four major variants 
being developed: Launder et al. (ref. 7), Shih and 
Lumley (ref. 8), Fu et al. (ref. 9) and Speziale et al. 
(ref. 10). The main difference between these variants 
is the pressure strain correlation modeling. For a de- 
tailed review of these models, see references 11-15. 
These models are just beginning to be evaluated for 
application to aerodynamic flows. 

The Reynolds stress closure can be simplified by 
introducing a stress-strain relationship: 

UjUj = — 2i 't(Sij + H.O.T .) 4- -Sijk (2) 

where = l/2(dU l /dx J +dU J /dx l ), v t is a turbu- 
lent eddy viscosity and the higher order terms (H.O.T.) 


contain nonlinear products of the strain and vorticity 
tensors, Sij and Clij = l/2(dUi/dxj — dUj/dxi ), 
respectively. The concept of including the high order 
terms in the stress-strain relationship was introduced 
in 1975 by Pope (ref. 16), who used the algebraic 
stress assumption of Rodi (ref. 17) to derive an ex- 
plicit form for the higher order terms. Currently, there 
are at least three variants for this type of model: Gatski 
and Speziale (ref. 18), Shih et al. (ref. 19) and Craft 
et al. (ref. 20). In all these models, the turbulent eddy 
viscosity, t/(, is related to the turbulent kinetic energy, 
k and its dissipation rate, e, by 

k 2 

vt — c M (S*,C2*)— (3) 


where S* and Cl* are the di mensio nless strain and 
vorticity invariants, S* = yzS^/c/e and Cl* = 


y 2Q'^ Ar/e, respectively, and the values of k and e are 
obtained from their corresponding modeled transport 


equations. 

Menter (ref. 21) observed that the ratio of produc- 
tion to dissipation of turbulent kinetic energy can be 
significantly larger than one in adverse pressure gradi- 
ent flows. Under such conditions, employing a con- 
stant value of Cfj, (« 0.09) leads to over-prediction of 
the turbulent shear stress. To remedy this problem, he 
proposed a modification to the eddy viscosity when the 
ratio of production and dissipation becomes large. His 
model provides significant improvement in predicting 
adverse pressure gradient flows, separated flows, and 
transonic shock separated flows (see fig. 2). 

Interestingly, his modification, although intuitive 
and tested for linear eddy viscosity models, is in accord 
with (3), proposed for the nonlinear models. Figure 3 
shows the variation of c M with S* compared with his. 
All models show a decrease in at high S* values 
corresponding to those for adverse pressure gradient 
and separated flows. Based on this observation, it is 
believed that the nonlinear models now under devel- 
opment will provide similar improvements. See for 
example references 22 and 23. 

The majority of models employed in practical ap- 
plications are linear eddy viscosity models. The value 
of eddy viscosity can be obtained by a family of two 
equation models, namely, k m e n — k p e q models. For 
example, if one picks m = 1/2, n = 0, p = — 1 and 
<7 = 1, one arrives at the q — u model. In theory, one 
form of the model can be transformed exactly into an- 
other form. Investigators have made refinements that 
lead to a wide variety of formulations. Among these. 
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the most frequently used are: the q-uj model (ref. 24), 
the k — e model (ref. 25), the k — uj model (ref. 26), the 
k - l model (ref. 27), the k - r model (ref. 28), and 
the SST model (ref. 21). The latter is a blend of the 
k - e model in the outer region and the k - u model 
in the near wall region. As mentioned above, it limits 
the ratio of production to dissipation. Results of com- 
putations with some of these models will be provided 
later. 

In order to enhance numerical robustness and ef- 
ficiency, Baldwin and Barth (ref. 29) proposed a sin- 
gle transport equation for v t . Spalart and Allmaras 
(ref. 30) proposed an improved version of a i/f model 
and results using this model will be shown subse- 
quently. Other variants of vt models were derived 
earlier. See for example reference 31. 

The most primitive form of eddy viscosity mod- 
els is formed by relating its value directly to the mean 
velocity. These algebraic models are often employed 
in applications because they are numerically robust. 
The most often used models are: the Baldwin-Lomax 
(ref. 32) and the Cebeci-Smith (ref. 33) models. John- 
son and King (ref. 34) improved the physical model- 
ing for adverse pressure gradient and transonic flow 
applications by introducing an additional O.D.E. that 
accounts for turbulence history effects. The modifi- 
cation greatly improved predictions of transonic wing 
performance (ref. 35). An example (ref. 36) showing 
calculations with this model of the flow field and pres- 
sures for a 747 wing-body combination is shown in 
figure 4. 

Several alternatives are available for modeling in 
the vicinity of solid surfaces: 1) the use of wall func- 
tions; 2) switching to a one-equation or a two-equation 
model near the wall; and 3) integrating the model equa- 
tions to the wall. The wall function techniques make 
use of the law of the wall. The region between the 
first grid point and the wall is divided into a single 
(ref. 37) or several zones (refs. 38 and 39). For com- 
pressible flows, the van Driest law of the the wall 
formally and correctly extends the wall functions to 
compressible flows (refs. 40 and 41). The use of one- 
equation (refs. 42-45) (or two-equation (ref. 46)) mod- 
els in the sublayer allows the transport of turbulent en- 
ergy to be accounted for. Despite success with the lat- 
ter approach many modelers prefer to use low Reynolds 
number damping that allows direct integration of the 
governing equations down to the wall. For a descrip- 
tion of the more commonly applied methods used with 
two-equation models see: the q — model of Coakley 


(ref. 24); the k — e models of Launder and Sharma 
(ref. 25), Chien (ref. 47) and Lien and Leschziner 
(ref. 48); the k — u> model of Wilcox (ref. 26); and 
the SST model of Menter (ref. 21). The k - e - v 2 
model of Durbin (ref. 49 and 50) allows direct integra- 
tion to the wall without recourse to a damping function 
by introducing an additional -equation, as does the 
Wilcox k — u model. 

The development of near wall modeling for 
Reynolds stress transport equations is still evolv- 
ing (refs. 51-56). Demonstration applications of these 
models are still limited to simple boundary layer flows. 

Favre averaging is the most common technique 
for extending incompressible models into the com- 
pressible flow regime. A comprehensive investiga- 
tion of the differences between Favre and Reynolds 
averaging may be found in Huang et al. (ref. 57). 
Generally, in addition to the compressible mean di- 
latation terms, additional terms such as the dilatation- 
dissipation and pressure-dilatation fluctuation terms 
arise and require modeling. Zeman et al. (ref. 58) 
and Sarkar et al. (ref. 59) independently proposed that 
dilatation-dissipation augments the solenoidal dissipa- 
tion by a function of M 2 , where Mt is the turbulent 
Mach number. Their models have been applied to com- 
pressible mixing layers and successfully predict the de- 
crease in shear layer spreading at high Mach numbers 
(ref. 60). Models for the pressure-dilatational fluctua- 
tion correlation have also been proposed (refs. 61-63). 
These models were also focused on predictions of sim- 
ple sheared mixing layers. Recent work by Huang et al. 
(refs. 57 and 64) suggests, however, that both of these 
models for dilatational-dissipation and the pressure- 
dilatation fluctuation correlations may not be useful 
for near-wall flows. Indeed, experience has shown 
that for prediction of subsonic and supersonic flows 
these two modifications degrade the results and are not 
recommended. 

For the prediction of hypersonic near-wall flows, 
Coakley and Huang (refs. 65 and 66) proposed two 
modifications for current two-equation eddy viscos- 
ity models: one compression modification to cure 
the under-prediction of separation bubble size caused 
by shock wave/boundary layer interactions; and the 
other, a length scale modification to remedy the over- 
prediction of heat transfer rate near re-attachment 
points. These two modifications have been validated 
for a range of hypersonic flows. The modifications are 
formulated in a general manner so they can be applied 
in any existing two-equation model formulation. An 
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example illustrating the effects of these modifications 
on the prediction of the hypersonic flow over a cylinder 
flare is shown in figure 5. 

3. PROCESS OF MODEL DEVELOPMENT 

In the Spring of 1994, a NASA Turbulence Mod- 
eling Standards Committee was formed to undertake 
an independent evaluation of the process of turbulence 
model development and suggest changes that could en- 
hance the quality of models used in CFD application 
codes. The Committee membership, comprised of ex- 
perts from NASA, Industry and Academia, is listed in 
the Acknowledgment section. 

The Committee established a set of turbulence 
modeling evaluation criteria or standards that turbu- 
lence modelers would be encouraged to apply. These 
criteria would enable CFD’ers to make intelligent 
choices for models to incorporate into their applica- 
tion code. In addition, they would provide modelers 
(and the aeronautical community at large) with rele- 
vant comparative metrics to assess progress on new or 
improved model development and to identify modeling 
shortcomings. 

Four critical elements of the process where change 
is necessary will be discussed here. The first involves 
numerical procedures. The second involves the se- 
lection and use of standard validation data bases as 
a means of assessing model performance. The third 
involves establishing standard numerical solutions to 
insure accurate implementation of models into appli- 
cation codes. The fourth involves the development of 
a mechanism for insuring that “successful” models get 
transported into application codes. This element is the 
most challenging and important part of the total pro- 
cess. It requires renewed cooperation among modelers 
and code developers. 

3.1 Numerical Procedures 

Integration of the conservation and accompanying 
modeling equations requires careful consideration of 
errors resulting from the numerical procedures. As 
discussed above, inattention to such procedures clouds 
the interpretation of a turbulence model’s performance. 


Various alternative methods for implementing 
models in RANS codes may lead to numerical sta- 
bility problems. In most cases, instabilities are caused 
by improper treatment of source terms. Often this is 
construed as “bad” modeling physics. Therefore it is 
essential that the modelers fully describe their proce- 
dures for handling source terms. A detailed discussion 
of the successful numerical strategies for implementing 
various types of models and corresponding computa- 
tional times is provided by Gatski (ref. 12). In addi- 
tion, sensitivity of the solutions to the number of grid 
points, to boundary conditions (e.g., free-stream and 
inflow) and to at the first grid point adjacent to the 
wall must be taken into consideration. 

The following solutions for an incompressible 
plate flat flow illustrate how sensitivity studies should 
be conducted and they serve to explain some of the fac- 
tors for the scatter of the results shown in figure 1 . The 
following conditions were used in the calculations un- 
less it is otherwise stated. The skin friction is reported 
at Re q = 10,000, where the solution is not affected 
by the inflow conditions. The ratio of turbulent vis- 
cosity to molecular viscosity in the freestream, \±ti Vi, 
and the ratio of the square root of the freestream turbu- 
lent kinetic energy to the freestream velocity, Vk/Uoo> 
were both taken to be 0.1 percent. The computational 
box was defined by Re l = 2 x 10 7 (resulting in Res 
up to 2.5 x 10 4 ) with a height to length ratio of 0.02. 
The grid points were expanded exponentially from the 
wall to the top of the domain with an expansion ratio 
determined by the choice of the value of at the first 
grid point. The value of at the first grid point was 
kept approximately 0.1. A detailed discussion is given 
in reference 67. 

Grid sensitivity. Computations using the several 
popular turbulence models were performed with 50, 
100, 250, 500, and 1000 grid points in the y direc- 
tion. This corresponds to approximately 35, 65, 145, 
265, and 465 grid points inside the boundary layer at 
Re q = 10000. The results, shown in figure 6, are 
presented as the percent error with respect to the so- 
lution obtained using 1000 grid points. The zero- and 
one-equation models are less sensitive to the grid re- 
finement. In general, errors can be controlled within 
less than 2 percent if 100 grid points are used in the 
calculations (corresponding to 60 grid points inside the 
boundary layer). 

Sensitivity to at the first grid point, . 

Computations were performed with y + & 0.014, 0.14, 
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0.4, 0.7, LI, and 1.4 using 500 points in the y- 
direction. The results, shown in figure 7, are presented 
as the percent error with respect to the solution ob- 
tained using « 0.014. The k-e model is the most 
sensitive. In general, one should limit the value of yf 
to be less than 0.3 to have accurate solutions. 

Freestream boundary condition sensitivity. 
Computations were performed by fixing the freestream 
value of y/k/Uoo at 0. 1 percent while varying the value 
of freestream turbulent viscosity to molecular viscos- 
ity ratio according to Ht/ni — 10 n . The values of n 
were chosen to be —6, —3, —1, and 0. Figure 8 shows 
the sensitivity as a percent of the value of the model 
solutions for n = —6. The k — u> model is very sensi- 
tive to freestream conditions. See Menter (ref. 68). In 
general, one should maintain the value of n less than 
—3 (for the k — u model). 

Code invariant test. Three codes were used to 
establish a standard solution for the incompressible fiat 
plate flow: a boundary layer code (ref. 69), an incom- 
pressible Navier-Stokes code (INS2D) (ref. 70) and a 
compressible Navier-Stokes code (ref. 71). The so- 
lutions for each code were established following the 
guidelines recommended above. Figure 9 shows the 
comparison of the results obtained by the three codes 
using Menter’s SST model. Differences in the region 
Re$ < 5000 were mainly due to the different inflow 
conditions used in the three solutions. Differences in 
skin friction coefficients are less than 1 percent af- 
ter Rcq > 5000. Comparisons using the other models 
show similar results. The solutions are essentially code 
independent and the results provide a standard numer- 
ical solution for each of the models. 


3.2 Standard Validation Data 

Turbulence modeling to a large extent is an em- 
pirical science. Models mimic the real physics and 
confidence is established by comparing modeled so- 
lutions against experiment or direct numerical simula- 
tions. Since direct numerical simulations are limited, 
comparisons with experiment provide the best measure 
of a model’s performance for engineering applications. 

The NASA Standards Committee deliberated ex- 
tensively on the type of data base needed to facili- 
tate interaction between modelers and CFD develop- 
ers. They concluded that a standard data base should 
be developed. They recommended the small set of ex- 
perimental test cases shown in table 1 as a first step 
in evaluating models for external aerodynamic flows. 
The choices were based on personal experience and 
knowledge about the data base and prior computations 
of them. The motivation was to rule out possibilities 
of including inferior data and unforeseen difficulties in 
specifying the boundary conditions. Furthermore, the 
flows were considered challenging enough to sort out 
modeling differences and could comprise the metrics 
for assessing model improvement. The majority of the 
flows are two-dimensional (2-D), mainly because there 
is still a dearth of well defined 3-D experiments. 

3.3 Standard Solutions 

Standard solutions for a number of the test cases 
employing several turbulence models have been es- 
tablished by researchers at the Ames Research Center 


Table 1 . Recommended test cases for external aerodynamic flows 



Subsonic incompressible 

Transonic 

Supersonic 

Priority 

cases 

Flat plate 

APG boundary layer (ref. 72) 

Self similar mixing layer 

Self similar round jet 

Self similar plane jet 

Self similar plane wake 

Infinite yawed wing (refs. 73 and 74]) 

Axisymmetric 
bump (ref. 75) 
RAE2822 airfoil 
(ref. 76) 

Flat plate M — 5 
Compressible 
mixing layer 
(ref. 77) 

Optional 

cases 

3-D boundary layer in 
transition duct (ref. 78) 
Concave and convex 
curvatures (ref. 79 and 80) 
Backward-facing step (ref. 81) 

MBB airfoil (ref. 82) 

M = 2.9 
incipient 
separation 
(ref. 83) 


6 




(ref. 67). The group, Dr. T. J. Coakley, Dr. J. A. Bar- 
dina, and Dr. P .G. Huang, maintained the rigorous 
standards for numerical procedures discussed previ- 
ously. In most cases several codes were used to insure, 
to as great a degree as possible, that numerical stabil- 
ity issues were eliminated. These benchmark solutions 
enable modelers and code developers alike to gauge 
model development progress. Moreover they pro- 
vide code developers with a means to validate model 
implementation. 

Four models were selected in their study: the 
Launder-Sharma k — t model (ref. 25), the Wilcox 
k — u model (ref. 26), the Spalart-Allmaras vt model 
(ref. 30) and the Menter SST model (ref. 21). Some 
example results follow. 

Driver’s adverse pressure gradient boundary 
layer Figure 10 shows comparisons of the pressure 
and skin friction coefficients. With the exception of 
the h — e model, all models predict flow separation. 
Overall the SST model provides the best solution. 

Bachalo-Johnson axisymmetric bump. Fig- 
ure 11 shows the comparison of the pressure coeffi- 
cients along the surface of the axisymmetric bump. 
Both k — e and k — to models predict shock positions 
too far downstream as a result of underpredicting the 
size of the separation bubble. The SST and Spalart- 
Allmaras models show better agreement. 

Transonic airfoil - RAE2822. The comparison 
of the pressure and skin friction coefficients are shown 
in figure 12. Again, both the k — e and k — u models 
predict the shock position too far downstream. All the 
models overpredict the pressure recovery toward the 
trailing edge. 

From these few examples it is apparent that a code 
developer would probably not want to use either the 
k — e or k — u) models in transonic flow applications. 

3.4 Turbulence Modeling Technology Transfer 

The last critical element of the process is the trans- 
fer of technology from modelers to code developers 
and application engineers. Historically, this has been 
the weak link in the process. The left diagram in fig- 
ure 13 depicts the flow of modeling technology for 
the typical development paradigm. The lower box and 
triangle represent the suite of test cases used to demon- 
strate model performance. The upper box and inverted 
triangle represent the more complex engineering appli- 
cations. The gap between causes a delay in the transfer 


because of the uncertainty in knowledge of how mod- 
els will perform in more complex applications and the 
numerical impact they might have on the performance 
of application codes. 

A new paradigm, depicted in the diagram on the 
right, is needed. An overlap must be created to affect 
timely transfer. It requires close cooperation between 
modelers, code developers, and application engineers. 
For example, modelers will need to cooperate in ex- 
tending evaluations to more complex flows and to ad- 
here to the standards discussed above; code developers 
will need to participate to some degree in the evalu- 
ation by performing some of the test flows with their 
own codes to insure models have been implemented 
properly. Code developers and application engineers 
will need to work with modelers to break down their 
very complex applications conceptually into more man- 
ageable generic flow representations in order to create 
a broader modeling standard data base. Creating the 
overlap will also provide a better feedback mechanism 
on model performance in complex flows that can spur 
timely improvements. 

Indeed, the pace at which “successful” models are 
implemented in application codes has accelerated in the 
few instances where this new paradigm is beginning. 
One such example was the formation of a Turbulence 
Modeling Integration Team at Ames Research Center 
whose focus was directed toward improving model- 
ing for high lift applications using the INS-2D code. 
Menter (ref. 21) was instrumental in developing his 
own model and assessing its performance along with 
other models by using many of the standard test cases 
recommended above. It is noteworthy that he used 
the basic algorithm in the INS-2D code to develop his 
model and make his assessments. As a result, Rogers 
(ref. 84) was able to make use of all his work almost 
immediately by transferring the model subroutines to 
the full INS-2D code. Feedback on model performance 
was almost immediate. The first publication dates for 
Menter’s model and Rogers’ benchmark high lift com- 
putations were separated by only six months (compare 
this with the difference of several years in dates for 
the development and application of the Johnson-King 
model in the benchmark wing calculation shown in 
fig. 4). 

Additional information was collected during the 
preparation of this paper to further show the impor- 
tance of the cooperative aspect of model development. 
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Table 2. Turbulence models available in NASA CFD codes 


Code 

Turbulence models available 

Supporting modelers 

0-equation 

1 -equation 

2-equation 

NPARC 

(Lewis) 

B-L 

P.D. Thomas 
Ahn’s RNG 

B-B 

S-A 

Chien k — e 
Shih-Lumley k - e 
k — lj 

Shih, Yang, and Zhu (CMOTT) 
Sirbaugh (NYMA) 

Georgiadis (Lewis) 

INS2D/3D 

(Ames) 

B-L 

B-B 

S-A 

SST 

Spalart(Boeing) 

Menter(Eloret) 

Rogers(Ames) 

CFL3D 

(Langley) 

B-L 

B-B 

S-A 

k — to 

SST 

Johnson and Barth(Ames) 
Menter(Eloret) 

Gatski and Rumsey(Langley) 
Abid(HTC) 


In table 2, a list of turbulence models available in sev- 
eral NASA application codes is provided. As a base- 
line in all these codes, the Baldwin-Lomax model is 
available. What is interesting is that the best of the 
newly developed one- and two-equation models were 
incorporated with the assistance of modelers. Some 
examples of benchmark calculations using the these 
models are presented next. 

The first example involves the calculation of 
a McDonnell-Douglas multi-element airfoil using 
INS-2D (ref. 84). The test data were the focus of a 
NASA CFD Challenge Workshop on high-lift hosted 
at NASA Langley. Lift curve variation with angle of 
attack to values near maximum lift were predicted quite 
well by the new models. Figure 14 shows a comparison 
of the calculations of pressure coefficient at a Reynolds 
number of 9 million and 21 deg angle of attack us- 
ing the two models that performed the best against 
the standard data base. Both the Spalart-Allmaras and 
SST models provide good predictions. The calcula- 
tions are not as good at and beyond maximum lift and 
that information feedback is spurring work on model 
improvements. 

Another example is the calculation of the flow 
over a military F/A-18 E/F wing section model 
(ref. 85). A major difference between the commer- 
cial and the military airfoils is that the military airfoil 
stalls at a markedly lower angle of attack (« 3 deg) 
due to leading edge flow separation. Figure 15 shows 
a comparison of the calculations and experiment for 
the pressure coefficient at a Reynolds number of 16 
million and 4 deg angle of attack. Again, calculations 
with the two models match the experimental data. 


Benchmark calculations (ref. 86) of a trans- 
port wing mounted on a circular cross section 
fuselage, have been made with the NASA TLNS 
3-D code (a derivative of CFL3D) as part of a 
code validation program. Figure 16 shows com- 
parisons with the measured pressure coefficients at 
two spanwise locations. The calculations using the 
Spalart-Allmaras and SST models show better agree- 
ment in the shock region compared with those us- 
ing the Baldwin-Lomax model. Better predictions 
of lift and moment coefficients are realized as a 
consequence. 

4. FUTURE OUTLOOK 

The evolution of turbulence modeling improve- 
ment requires substantial and synergistic interaction 
among CFD developers, modelers, and experimen- 
talists. It was shown above that the pace of de- 
velopment could be accelerated through a coordi- 
nated effort. What needs to be done in the fu- 
ture is to expand the concept and open it to greater 
participation. An excellent vehicle for accomplish- 
ing this is to establish a turbulence model infor- 
mation system data base, accessible on the internet 
through the World Wide Web. The information sys- 
tem would provide streamlined access to the infor- 
mation needed to gage development of turbulence 
models, to correctly implement them into application 
codes and to provide feedback for initiating timely 
improvements. 

Figure 17 presents a conceptual sketch of a possi- 
ble information system. The inner shell is the heart. It 
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would contain such information as model descriptions, 
numerical strategies, standard data bases, and stan- 
dard numerical solutions showing comparisons with 
the data base. As a dynamic and evolving system it 
could be continually updated as developments warrant. 
The outer shell is comprised of CFD’ers, modelers, 
and experimentalists. Individually or in teams they 
would have streamlined access and coordination chan- 
nels through the Web. For example, modeler’s could 
access the standard benchmark test cases to measure 
their improvements; experimentalists could determine 
gaps in the data base and propose and perform addi- 
tional experiments from a more informed perspective; 
and CFD developers and application engineers would 
have the opportunity to make informed choices of mod- 
els and validate their implementation. Teams could be 
formed, formally or informally, as a means of acceler- 
ating development for specific applications. Geograph- 
ical and organizational boundaries would not have to 
be considered but access to some of the information 
could be controlled, if necessary. 

An oversight filter for the heart of the system 
would have to be provided in order to avoid prolifera- 
tion of unchecked information. This could be accom- 
plished by forming an oversight committee comprised 
of members from academia, industry and research lab- 
oratories. The committee could meet at regular inter- 
vals to evaluate progress, to discuss application needs, 
to concur on updating the experimental and numerical 
data bases, and to make informed assessments on the 
current state-of-the-art. 

With such a system in place, the future prospects 
for providing timely, accurate RANS codes for engi- 
neering applications are promising. 

5. CONCLUDING REMARKS 

Turbulence modeling is critical to the develop- 
ment of accurate RANS CFD codes. Progress in model 
improvement has been evolutionary over the past few 
decades. It is now possible to predict pressure distri- 
butions in aerodynamic applications with confidence 
using mixing length eddy viscosity models so long 
as the pressure gradients are small and shock waves 
are weak because these models give correct viscous 
displacement effects. Skin friction and heat transfer 
can also be predicted to engineering accuracy’s (5 per- 
cent), but attention must be given to grid refinement 
and free stream boundary condition influence on the 


model choice. The situation is quite different for ap- 
plications involving strong pressure gradient, strong 
shock waves, and separation. When the flow is either 
subsonic or supersonic and any separation regions are 
small, eddy viscosity models, both mixing length and 
1- and 2-equation models, can also provide adequate 
predictions of pressures because displacement effects 
are properly computed. Eddy viscosity models must 
be modified to properly account for shock location and 
attendant small separation for transonic flows before 
pressures can be predicted because the displacement 
effects which have a first order influence are not cor- 
rect. The model of Johnson and King is an example 
of an improvement to mixing length models to han- 
dle this situation. No definitive conclusions regarding 
the ability to predict skin friction and heat transfer in 
these applications, or for that matter even pressures and 
separation extent for applications involving the strong 
interactions, can be given. Progress toward this end is 
being made by improving eddy viscosity models and 
moving toward higher-order model closures. Indeed, 
prospects are good. However, these improvements are 
not always recognized by the CFD developers, their 
pace appears too slow, and perhaps more importantly, 
their timely introduction into application codes is not 
being realized. 

Four critical elements of the process for model 
development were examined in detail and systematic 
procedures were proposed to remedy the situation. The 
first involved insurance that adequate numerical proce- 
dures were followed to establish such things as source 
term stability, grid refinement, and free stream bound- 
ary condition requirements. The second involved the 
creation of a standard data base to provide benchmarks 
for assessing progress. The third involved the creation 
of standard numerical solutions to insure accurate uti- 
lization of models in application codes. The fourth 
involved following a systematic mechanism for trans- 
fer of “successful” models into the application codes. 
All of these elements require renewed cooperation be- 
tween model and code developers. In a small num- 
ber of instances where these procedures are followed, 
model improvements were implemented in application 
codes in a timely fashion. Moreover, the feedback 
from benchmark application computations has spurred 
modelers to search for new improvements. 

In the future, these procedures need to be refined 
and opened to greater participation among the model- 
ing research and application communities. A logical 
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path to this end can be realized using a turbulence in- 
formation system data base. The heart of the system 
would contain such information as model descriptions, 
numerical strategies for solving the model equations, 
standard data bases, and standard numerical solutions. 
It would be a “living” system with filtered, continuous 
updating. Access to the system could be easily devel- 
oped over the internet through the World Wide Web. 
Such an approach holds great promise for the future 
prospects of turbulence modeling. 
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Figure 1. Flat plate skin friction compared with U + 
at y + = 100. 
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Figure 2. Pressure coefficients along the surface of 
(a) the transonic bump and (b) the RAE 2822 Case 10. 
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Figure 4. Improved turbulence model for a separated 
flow calculation of a 747-200 aircraft, M 0 0 = 0.85, 
a = 5.7°. 
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Figure 7. Sensitivity of predicted skin friction on a a 
flat plate to the value of y+. 



Figure 8. Sensitivity of predicted skin friction on a flat 
plate to free stream boundary conditions. 



Figure 9. Code-to-code comparison of predicted skin 
friction on a flat plate. 
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Figure 10. Comparison of surface pressure and skin 
friction coefficients: Driver’s adverse pressure gradient 
flow. 



Figure 11. Comparison of surface pressure friction 
coefficient: Transonic bump flow: M = 0.875 and 
Re/ L = 13.1 x 10 6 /m. 
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Figure 12. Comprison of surface pressure and skin 
friction coefficients: RAE2822, Case 10. 



Figure 13. Old and new paradigms used in turbulence 
model development. 
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Figure 14. Prediction of surface pressure coeffi- 
cient on a McDonnell-Doublas multi-element airfoil. 
Re = 9 x 10 6 and a = 21°. 
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Figure 15. Prediction of surface pressure coefficient 
on a F/A-18E/F multi-element airfoil. Re = 12 x 10 6 
and a = 4°. 
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Figure 16. Prediction of surface pressure coefficient on transport wing/simple body configuration. Moo = 0.88 
and a = 0.47°. 



Figure 17. A conceptual information system for turbulence modeling. 
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